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We show techniques of analyzing complex dynamics of cellular automata (CA) with chaotic 
behaviour. CA are well known computational substrates for studying emergent collective be- 
^o haviour, complexity, randomness and interaction between order and chaotic systems. A number 

i-H of attempts have been made to classify CA functions on their space-time dynamics and to 

IJ predict behaviour of any given function. Examples include mechanical computation, A and Z- 

• i-H parameters, mean field theory, differential equations and number conserving features. We aim to 

/\ classify CA based on their behaviour when they act in a historical mode, i.e. as CA with mem- 

ory. We demonstrate that cell-state transition rules enriched with memory quickly transform a 
chaotic system converging to a complex global behaviour from almost any initial condition. Thus 
just in few steps we can select chaotic rules without exhaustive computational experiments or 
recurring to additional parameters. We provide analysis of well-known chaotic functions in one- 
dimensional CA, and decompose dynamics of the automata using majority memory exploring 
glider dynamics and reactions. 
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1. Introduction 

In this paper we consider a simple tool to extract complex systems from a family of chaotic discrete 
dynamical system. We will employ a technique — memory based rule analysis [Alonso-Sanz fc Martin 
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20031, Alonso-Sanz, 20081, Alonso-Sanz, 2009], Alonso-Sanz, 2009a|, of using past history of a system to 



construct its present state and to manipulate its future. 

We focus on one-dimensional CA. CA are well known computational substrates for studying emergent 
collective behaviour, complexity, randomness and interaction between order and chaos. A number of efforts 
have been made to classify C A functions on their space-time dynamics and to predict behaviour of any given 
function. Examples include mechanical computation, A and Z-parameters, mean field theory, differential 
equations and number conserving features. We aim to base CA classification on their behaviour in a 
historical mode, i.e. as CA with memory | Alonso-Sanz[ [20 08 . 

We study elementary CA (ECA) where each function evaluates a central cell with their two neigh- 
bourhoods (left and right) and every cell takes a value of its binary alphabet. ECA are introduced and 
extensively studied by [Wolfram, |1984| , [Wolfrani , 2002| . In ECA there is a set of functions determining 
global chaotic behaviour where global configurations are chaotic, many configurations have many ancestors, 
and attractors are dense 



Wuensche & Lesser, 1992 . 



ECA is a one-dimensional array of finite automata, each automaton takes two states and updates its 
state in discrete time depending on its own state and states of its two closest neighbours, all cells update 



their state synchronously. A general classification of ECA was introduced in [Wolfram, 1994), as follows: 



• class I. CA evolving to a homogeneous state. 

• class II. CA evolving periodically. 

• class III. CA evolving chaotically. 

• class IV. Include all previous cases, as well known as class of complex rules. 

In this classification class IV is of particular interest because the rules of the class exhibit non-trivial 
behaviour with rich diversity of patterns emerging and non-trivial interactions between travelling localiza- 



tions, or gliders, e.g. ECA Rule 54 Martinez et a/., 2006| 



In present paper we aim to transform a chaotic evolution rule to a complex system by using memory 



chaotic ECA 



memory 



> complex ECA 



and derive a new classes of CA functions with historic evolution. 

We believe that by employing historic evolution we are able to explore hidden properties of chaotic 
systems, and select chaotic rules with homogeneous dynamics. 

2. Basic notation 

2.1. One- dimensional cellular automata 

One-dimensional CA is represented by an array of cells Xi where i ^ Z (integer set) and each x takes a 
value from a finite alphabet S. Thus, a sequence of cells {xi} of finite length n represents a string or global 
configuration c on H. This way, the set of finite configurations will be represented as S^. An evolution is 
represented by a sequence of configurations {q} given by the mapping $ : S^ ^ S^; thus their global 
relation is following 



$(c^) -^ d 



,t+i 



(1) 



where t is time steps and every global state of c is defined by a sequence of cell states. Also the cell states in 
configuration c^ are updated at the next configuration c^+^ simultaneously by a local function ip as follows 



ip{x, 



t 

i—r") ' 






-^ X 



t+1 



(2) 



Following I Wolfram, 1984| , Wolfram] 2002 one can represents any CA with two parameters {k,r). 
Where A: = IS | is a number of states, and r is a radius of neighbourhood. Thus ECA are defined by 
parameters (2, 1). There are S^ different neighbourhoods (where n = 2r + 1) and k^"^ different evolution 
rules. 

In computer experiments we are using automata with periodic boundary conditions. 
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2.2. Cellular automata with memory 

Conventional cellular automata are ahistoric (memoryless). A new state of a cell depends on the neigh- 
bourhood configuration solely at the preceding time step of Lp (see Eq. [2]). 

CA with memory extends standard framework of CA by allowing every cell xi to remember some 
period of its previous evolution f Alonso-Sanz[ [2008 . 

Thus to implement a memory we design a memory function 0, as follows: 



(j){x 



t-T 

i 



, . . . , X^ , X^ j r Si 



(3) 



such that r < t determines the degree of memory backwards and each cell 5^ G S is a state function of the 
series of states of the cell Xi with memory up to time- step. To execute the evolution we apply the original 
rule as follows: 



vi 



. . . , ^i-ii ^ii ^i-\-i 



^i^ ^i-\-l^ • • •) ^ X, 



t+1 



In CA with memory, while the mapping (p remains unaltered, historic memory of all past iterations is 
retained by featuring each cell as a summary of its past states from (j). Therefore cells canalize memory to 
the map ip. 



classic EGA (ahistoric) 
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Fig. 1. Cellular automata with memory in cells. 



For example, let us consider memory function as a majority memory: 



'^maj 



(4) 



where in case of a tie given by Hi = Sq in 0, we shall take the last value xi. So (j)mai represents the classic 



majority function for three variables Minsky, 1967 , hence we have: 



(j^maj '• {Xl A X2) V (X2 A X3) V (^3 A Xi) ^ X 

on cells (x^~^, . . . ,x^~^,x^) and define a temporal ring before calculating the next global configuration c. 
The representation of a EGA with memory [Martinez et al. , 2010j is given as follows: 



(j^CARm-.T 



(5) 
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where CAR is a decimal notation of a particular EGA rule and m the kind of memory given with a specific 
value of T. Thus the majority memory {maj) working in EGA Rule 86 checking tree cells (r = 3) of history 
is simply denoted as: 0i^86maj:3- Figure IT] depicts in detail the memory effect working on EGA. 

Note that memory is a simple function but its global behaviour $ can be predicted from its local 
function (f) and if. 

3. Classes of ECA by polynomials 

3.1. Mean filed approximation 

Mean field theory is a proven technique for discovering general statistical properties of GA without analyzing 
evolution spaces of individual rules [M cintosh] [200 9 [. 

The method assumes that elements of the set of states S are independent, uncorrelated between each 
other in the rule's evolution space (p. Therefore we can study probabilities of states in neighbourhood in 
terms of probability of a single state (the state in which the neighbourhood evolves), thus probability of a 
neighbourhood is the product of the probabilities of each cell in the neighbourhood. 

In this way, it was proposed to explain Wolfram's classes by a mixture of probability theory and de 



Bruijn diagrams in Mcintosh, 1990 , resulting in a classification based on mean field theory curve: 



class I: monotonic, entirely on one side of diagonal; 
class II: horizontal tangency, never reaches diagonal; 
class IV: horizontal plus diagonal tangency, no crossing; 



• class III: no tangencies, curve crosses diagonal. 

Thus for one dimension all cell neighbourhoods must be considered as: 

Pm= E ^.(^K(l-Ptr-^ (6) 

such that j is a number of relations from neighbourhoods and X E S represent of cells x^_^, . . . , x^, . . . , x^+^. 
Thus n represents the number of cells in neighborhood, v indicates how often state one occurs in the 
neighborhood, n — v shows how often state zero occurs in the neighborhood, pt is a probability of cell being 
in state one, qt is a probability of cell being in state zero (such that q—l—p). 

4. Complex dynamics emerging from chaotic ECA 

4.1. Chaotic ECA 

Let us consider two cases of classic EGA with chaotic behaviour to demonstrate our results: the evolution 
rules 86 and 101. 

We need to provide their mean filed approximation to verify that both function have a chaotic global 
behaviour before selecting the memory. 

The local rule (p corresponding to rule 86 is following: 

_ flif 110, 100,010,001 

^i?86 - 1 if 111, 101, Oil, 000 • 

Initially p)R^Q has produces states zero and one with the same probability. There is an equilibrium of 
states in $. On the other hand, p)Rm determines a surjective correspondence and therefore every config- 
uration has at least one ancestor and no Garden of Eden configurations [Amoroso & Gooper, 1970]. Of 
course this rule is the reflection of well-known EGA rule 30 [Wuensche fc Lesser , 1992] . 

The local function for rule 101 is following: 



1 if 110,101,010,000 
V^moi - jo if 111,100,011,001 
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(a) 



(b) 



Fig. 2. Chaotic global behaviour in EGA evolution rules (a) (^r^q and (b) (^riqi evolving over an array of 295 cells in 295 
generations. Both evolutions start in configurations with the same random initial density of 50%. 

In this case, <^rioi has the same probabihty as ^Pr^q to produce states one and zero. However (^rioi is 
not a surjective rule and therefore has the Garden of Eden configurations, i.e., not ah configurations have 
ancestors. 

To classify global behaviour properly of <^Rm and (^ri{)i we should calculate their mean field polyno- 
mials. Mean field polynomial for ipR^ is: 



Pt^i = 'iptq^ + plqt 



(7) 



and for (/?rioi we have: 



Pt+i 



2pjqt+ptqt+ql 



(8) 



The polynomial for ^pr^q satisfies the mean field classification (Sect. 3). Where rules in CA class III do 
not have tangencies and therefore the curve crosses the identity. Consequently, ^r^q evolves with a chaotic 
global behaviour (see Fig. [SJ^a)). 

This mean field polynomial has an stable fixed point when Eq. [7| is / = 0.5. This value relate the 
existence of densities where the population of cells in state one is preserved with few changes. Also such 
fixed point confirm its initial probability since (/^i^se- Of course, if there are extreme densities of zeros and 
ones then next time the configuration will be filled of states zeros only, a homogeneous global state. 

Mean field curve for ^pRioi (see Fig. [3]^b)) presents another characteristic. Again the curve does not 
cross the identity and its global behaviour $ should then be chaotic. Its stable fixed point / = 0.5 relates 
to the initial probability estimated since (/^i^ioi- The curve displays what would happen if some initial 
configuration cq is dominated by state one, at the next step will be dominated by states zero and therefore 
this behaviour should repeat periodically. Such phenomenon also is balanced with its 50% of density to 
each step. 

Finally Fig. [2] displays two evolutions with typical chaotic behaviour in EGA. First evolution (a) 
displays the chaotic global evolution of ^Rm since a random initial condition with a 50% of density. That 
confirm an evolution without some order or pattern defined. Second evolution (b) displays the chaotic 
global behaviour for ifRioi with the same parameters. 

Now we will select a kind of memory and uncover "hidden" properties of chaotic EGA's. 
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Fig. 3. Mean field curves for (a) ^r%^ and (b) ^r\^\ respectively. 



4.2. Filtering evolutions 

Filters selected in CA are a useful tool for understand "hidden" properties of CA. This tool was amply 
developed by Wuensche in a context of automatic classification of CA. The filters were derived from 
mechanical computation techniques [Hanson fc Crutchfield , 1997 and analysis of cell-state frequencies 
[Wuenschej |1999| 



Others derivations deducing filters relate as tiling, were reported for EGA rule 110 Martinez et al. 
2006|, and rule 54 |lMartinez et a/., 2006|. However in general such filters are not widely exploited in CA 



studies. We consider the tile representation to identify filters as block of cells in one or two dimensions. 
We explain each tile filtering (fuse and (fmoi in the Sec. 4.3. 



4.3. Complex dynamics emerging from (^rsq and v^i^lol with majority memory 

Firstly we should consider a kind of memory, in this case the majority memory (l)maj (see Eq. B and then 
a value for r. This value represents the number of cells backward to consider in the memory (as we saw in 
Sec. 2.2). 

Implementing the majority memory (f)maj we can select some EGA and experimentally explore its 
effect. Figures [4] and [5] show outcomes of selecting memory r working on (fuse and (fmoi respectively. The 
result is a new family of EGA but now with majority memory, they are the rules: (f)R86maj:3^ • • • ? ^t^Rsemaj :oo^ 

and 0mOlmaj:35 • • • 5 4^R101maj:oo- 

As a characteristic while the memory is working on (j)R86maj and (l)Rioimaj a periodic background was 
more evident and it can be represented as a tile. These filters work as well on the original rules (/p, see 
Fig.|4]and[5j 

The memory effect produces an emergency of patterns. The patterns interact quickly (in time-scale of 
GA development) with each other. In fact, for (j)R86maj and some values of r the original behaviour changes 
its dynamics dramatically. Following our previous findings [Martinez et a/., "2010 , in press] we consider 
only even values that offer better global dynamics. Thus the new rule 0i^86maj:8 displays particles travelling 
in different velocities on a periodic background (see Fig. [i]). 

The second case (t)Rioimaj displays more attractive result. These three rules support stationary and mo- 



bile particles, travelling and colliding, some collisions can be interpreted as solitonic reaction [Adamatzky 
2002] (see Fig. [S]). 
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T = 18 



T = 19 



T = 20 



T = 21 



Fig. 4. Majority memory 4>R&&maj:T working in (ySfise with r values of 3 to 21, respectively. The flrst one is the original 
EGA rule 86 evolution. All snapshots evolve with the same random initial condition of 50% over an array of 300 cells to 300 
generations, all evolutions are filtered. 
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Fig. 5. Majority memory (/) Rioimaj :t working in (fRioi with r values of 3 to 21, respectively. The first one is the original 
EGA rule 101 evolution. All snapshots evolve with the same random initial condition to 50% over an array of 300 cells to 300 
generations, all evolutions are filtered. 
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Also on all evolutions a filter was selected to clarify evolutions and patternsj^ Filters really are useful 
to recognize periodic dominant patterns of objects moving into such local universes. 

The first two-dimensional tile working in (j)R^Qrnaj is represented as t^gg 



101 



Also this tile works 



on the original evolution rule as shows the Fig. Ill Tile reported for (j)Rioimaj is determined for the two- 
dimensional tile t^,,, = -.^^ . So this filter works on the original evolution rule as well as shows the Fig 



100 



The effect of memory producing new evolution rules is preserved in some way. Initially the existence o 
a filter that can evolve on all different function, that is not rare because the memory only read the history 
and process the new generation with the original rule. 



4.4. Coding particles 

4.4.1. Self- organization by structure formation 

Patterns as particles and non-trivial behaviour emerging in these new CA with memory (j)Rmmaj and 
(j)Rioimaji naturally conduce to well-know problems as self-organization. 




gi g2 gs g^ g^ 

Fig. 6. Set of particles G emerging and living in (/^Rioimaj-A- 



Considering the evolution rule (/^Rioimaj-A^ we have done a classification of particles in this local universe 
(see Fig. p|. The universe is not bigger compared with other complex rules. However that all particles in 
(j^Rioimaj'A Can be produced from other particles in binary collisions. Such self-organization by structure 
formation [Kauffman , 1993| is demonstrated in the following set of reactions between particles: 



9i -^ 9j = 9k 



such that i ^ j ^ k and z, j, k G ^(/)^ioi 



1 tnat Z ^ J ^ /C and Z, J, /C G ^</>^ioima,:4- 

Figure [7| presents the set of reactions necessary to produce every particle: 



a) g4 

b) 91 

c) 91 

d) 91 

e) 93 

f) 93 



-b'-95 
■b'-g, 
-b^-9A 
-b^-95 
■b'-94 
■b'-g. 



91 
92 
93 
■94 
95 



Of course, they are not all possibilities to get every particle and a organization of several particles 
could be produce even more complex behaviour imitating physical, biological, chemical or computational 
phenomena: wave propagation, reaction-diffusion, morphogenesis, particle collision, fluid-dynamics, (tissue) 



All evolutions simulated to EGA and EGA with memory they are calculated with 0SXLGAU21 system, available from 
mttp://uncomp. uwe.ac.uk/genaro/OSXGASystems. html 
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gi 92 93 9a 95 

Fig. 7. Self-organization by particle collisions. The set ^^jjioi^a 4 ^^ produced. CA evolution is filtered. 

grown, pattern formation, self-reproduction, self- assembly, artificial life, synthetic constructions (engineer- 
ing), tessellation, differential equations, soliton solutions, formal languages, or unconventional computing 
iAdamatzky[|2002] , [Bar-Yam[ jlQQTj , [Margensternj [2007] , jMitchelll [2009] , and [Moritaj |T998j . 



4.4.2. Generator pattern 

Figure [8] shows the evolution of CA from a single cell in state 1, the automaton is governed by rule 
0i?86maj:8- A fusc pattern is organized by stream of gliders (left) emitted periodically every 62 steps and a 
fixed periodic pattern (right) growing with a velocity of — |. 

The above examples of CA with memory are just two simple cases showing the memory effect on 



traditional chaotic functions. Another cases were developed for the ECA rules 30 and 126 in [Martinez et 



a/., 2010. 



4.4.3. Implementing basic computing functions 

We can employ the particles codification to represent solutions of some basic computing functions. Let us 
consider the rule (j^Rmmaj:^- We want to implement a simple substitution function addToHead working on 
two strings wi = Ai, . . . , An and W2 — Bi^ . . . ^ Bj^, where n,m > 1. For example, if wi = AAA, W2 = BBB 



and ws = wiW2 then the addToHead(|it;2|) will yield: ws = W2Wi (see schematic diagram of Fig. 10). 

To implement such function in (l)RS6maj:8 we must represent every data 'quantum' as a particle. Gliders 
gi and g2 are coded to reproduce a soliton reactionjj Another problem is synchronize several gliders and 
obtain the same result with multiple collisions. 

The codification is not sophisticated however a systematic analysis of reactions is required. We known 
than a periodic gap and one fixed phase between particles is sufficient to reproduce the addToHead function 
for any string A^B^. 

Figure [9] shows fragments of evolutions of (f)R86maj:8 from an initial condition coded by gliders, repre- 
senting the string AAAAAAAAAAAABBBBBBBBBBBB. Using function addToHead we produce the 
final string BBBBBBBBBBBBAAAAAAAAAAAA after 6,888 generations. The first snapshot in Fig.|9] 
shows its initial configuration and the first 400 steps, the middle snapshot mainly presents how the string 
wi across the string W2 preserving the information (soliton reaction), and the third snapshot shows the 
final global configuration so given the string W2Wi processed in parallel with (f)R86maj:8- 



These gliders are a reflection of (l)R30maj:8^ because ECA rule 86 is the reflection of rule 30, and consequently their gliders 



emerging with memory can be coded in a similar way Martinez et al. 2010 . 
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Fig. 8. Stream of particles and fuse patterns emerging from a single cell in state 1 with 
unlimited growth. 



maj:8' 



These patterns exhibit 



5. Discussion 

We have demonstrated that elementary cehular automata (EGA) with memory offer a powerful approach 
to discovering complex dynamics based on particles and non-trivial reactions between the particles. Such 
problem has been substantiated by a number of different techniques, e.g. number-conservation 
Imai et a/., 2004| , exhaustive searc h [Eppstein , 2002 , tiling | Martinez et a/., 2006 



Fuks, 2002 



stern 



Boccara &; 



[Margen- 



2007| , de Bruijn diagrams [Martinez et a/. , |200 8|, Z-parameter |Wuensche, 1999| , genetic algorithms 



Das et a/., 1994], mean field theory [Mcintosh , 1990J or from a differential equations point view [Chua 



20071. Thus the memory function offers a more easy way to get similar and, in some cases, more strong 



results reporting new complex rules in EGA with memory. 

We have enriched some classic chaotic EGA rules with majority memory and demonstrated that by 
applying certain filtering procedures we can extract rich dynamics of travelling localizations. Therefore, 
we can deduce a relation on chaotic systems decomposed in complex dynamics as a self-contained set. 
Generally a relation of sets of complex dynamics can be self-contained describing $ as attractors, like a 
set diagram (Fig. 11 |Adamatzky et a/. , |2006j ). 

This way, the most bigger set in Fig.|lipall orbits' corresponds to complex dynamics and the 'unstable' 
set represents the chaotic systems. Indeed there is a number of properties between orbits and characteristics 
that cannot be inferred directly. However the memory plays a role of a powerful tool to discover such 
properties. Finally, the memory function can be applied to any GA or dynamical system. 
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Fig. 9. A simple substitution system processing the word A B to B A with 0i?86maj:8- The final production is reached 
on 6,888 generations by synchronization of multiple soliton reactions. 
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Fig. 10. Schematic diagram adding the string W2 to head of the hst ws. 




Fig. 11. Classes of global behaviour. 
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